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1, INTRODUCTION 

Human computer interaction has become a vital aspect in human life due to advancement of 
technology in augmented reality, virtual reality and wearable technology. Hence, the need of technology that 
can integrate with our own body and gesture has become prominent. Nowadays, it is possible to integrate full 
computer in the size of our hand as well as creating technologies which can process at high speed with low 
cost and low power consumption. This allow us to bring intelligence close to our fingertips and make it able 
to carry everywhere. Thus, it is possible to be able to create a wearable or portable device with enough 
processing power as well as able to compute and interpret data from electrodes or sensors to deliver fast and 
accurate data. 

There are a lot of technologies can interpret hand gestures or movement. A wearable technology 
based on vision to recognize hand movement was proposed in [1-2]. It is a combination of an integrated 
Analog Front End and embedded processing which provides high quality signal acquisition and on-board 
digital processing capabilities with a contained power consumption. However, it requires camera to be 
mounted in the environment which inherently suffer from a limited range of vision as well as expensive to 
implement and privacy issue. Wu et al (2016) has proposed a glove-based SLR system to recognize sign 
language by the combination of IMU and sEMG sensors. The device is accurate and able to detect the 
slightest change in movement [3-5]. However, the device is costly and requires a lot of sensors which is 
uncomfortable and unpractical for daily life usage. 
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Recently, IMU technology is gaining popularity due to its low cost and less power consumption. A 
study in [6-8] proposed a wearable technology to detect gesture based on IMU system. However, IMU sensor 
has limitation to detect the fine motion of a hand and fingers. It has limitation to detect more hand gestures 
due to its measurement only for acceleration and gravity from 3-axis. Surface electromyography (SsEMG) is a 
tool to collect biological electrical signal during neuromuscular activity from the skin surface through 
electrode. The signal was then amplified, displayed and recorded. It exists in different degree of correlation 
with muscle function and activity states that reflect neuromuscular activity at some level. sEMG is a non- 
invasive, real time and multiple target, neuromuscular disease diagnosis in clinical medicine, rehabilitation 
medicine in the field of muscle function evaluation and fatigue assessment in sports science, exercise 
technology and analysis [9]. There are many researches focuses on pattern recognition of sEMG to 
differentiate limb motion. 

The EMG signals were recorded and classified using K-Nearest Neighbours (K-NN) and Linear 
Discriminant Analysis (LDA) where LDA has become the most accurate classifier method obtained [10-12]. 
A portable sEMG sensor however can measure the hand gesture through the acquisition of muscle electrical 
activity using less sensor requirement [2], [13-16]. 

However, the complexity of electromyography signal produce causes the arm motion state difficult 
to determine. Studies on biological signals have provided interpretation of EMG signals and new methods for 
modelling and classifying hand movements. A control system must have accurate, intuitive control and 
acceptable response time to be successful. Hence, it is important for the control system with almost 100% 
accuracy so that user can perform the desired movement. The response time of the control system should be 
short enough for the user to understand [3]. 

In this study, we intend to create a system that can recognize basic hand gestures using two channel 
surface EMG signal where the system used different classification techniques which are Principle 
Component Analysis (PCA) and classification and regression tree using distinctive time domain features. The 
SEMG electrodes are located at the forearm to acquire signal which will then need to be extracted, analyzed 
and classified to interpret the detection of hand gestures which are rock, paper and scissors. 

The system proposed is a low cost and require simple analysis of hand gesture. Many publications 
used time domain as the main tool to extract features due to its obvious advantage from frequency domain 
[17]. However, each author used different time domain feature to recognize the body movement. PCA is a 
less computational requirement which uses Euclidean distance equation and the classification and regression 
tree was used to measure the purity of the results [18-20]. The study used time domain as a feature extraction 
tool due to its nature of having good discrimination power and less computationally intensive. 

The rest of the paper is organized as follows: In part HI, a methodology of the research is presented 
including the experimental setup; Part III is a presentation of results and discussion; Part IV 
gives a conclusion. 


2. RESEARCH METHOD 

Figure | shows the block diagram for hand gesture classification system. Five healthy samples that 
do not have damage in their right arm participated in the project. The subjects are chosen from the age range 
20 to 25 years old. The subject was asked to sit and relax while placing the arm on the lap. The arm was 
wiped with alcohol swab to remove dirt and sweat. The electrodes were then placed with some EMG paste to 
increase conductivity of the electrode. The measuring signal was start after 30 to 60 seconds. The electrodes 
are placed at the forearm which is near to flexor carpi radialis longus muscle as shown in Figure 2. It 1s based 
on most researchers due to ability to get high recognition rate from this muscle [3], [21-23]. The bipolar 
configuration was used to improve the signal to noise ratio (SnR) of the sEMG signal reading. The electrodes 
were placed 2 cm apart from each other. 
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Figure 1. Block diagram for hand gesture classification system 
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Figure 2. Electrode placement with bipolar configuration 


The signal acquired were feed to BMA-400 AC/DC low noise basic amplifier and transducer to 
amplify the biomedical signals from the electrodes. It has extremely low noise output, sharp cut-off bandpass 
filters and wide gain range as well as having high impedance instrumentation differential amplifiers to filter 
and isolate initial noise. The signal was then converted into digital using Analog to Digital Converter, USB- 
6009. It is low cost multi-function DAQ device from National Instrument to convert analogue signal from 
transducer and amplifier to be converted into digital. 

Each subject was asked to perform hand gesture as in Figure 3 which are rock, paper and scissors. 
They need to repeat the hand gestures for 25 times each. The experiment was repeated three times 
corresponding each gesture. The data collection was observed to ensure there will be unobvious errors made 
during the process. Each gesture was repeated at a time interval of 4 seconds which resulted 60 to 70 seconds 
total recording time for each gesture. The sampling frequency used was 1000 Hz. at the end of experiment, 
the data from three samples, while the rest of the data were corrupted by noise and unusable. 








(d) (€) (f) 


Figure 3. Hand gestures a) scissor back hand b) rock back hand c) paper back hand d) scissor front hand e) 
rock front hand f) paper front hand 


Raw EMG data always suffer from noise should be removed to ensure good classification rate. The 
raw data was sent to MATLAB to be filtered, rectified and any DC offset were removed. A 2nd order 
Butterworth band-pass filter with 10-500 Hz cut off frequency was used. Figure 4 shows the signal before 
and after filtration process. DC offset was removed using ‘detrend’ function in MATLAB. 


Indonesian J Elec Eng & Comp Sci, Vol. 15, No. 3, September 2019: 1366 - 1373 


Indonesian J Elec Eng & Comp Sci ISSN: 2502-4752 O 1369 


Hh 
; ie ; | | | 1 | | 
. pln fia peat pad anh ty i Wprbeain afl MA minacApmwtefl eal. fy 
L i 


vit! 


Figure 4. Signal before and after filter 


The most crucial step in classification of EMG signal is the feature extraction process as the 
accuracy and realty of classification process relies heavily on the selection of features. In this study, we used 
time domain instead of frequency domain due to the most preferable by most papers which is having a good 
discrimination power and less computationally intensive. There are large number of features have been 
proposed and studied for both sEMG and IMU sensors for detecting activities and gestures. Hence, we 
adopted some of well-established features [3], [15], [21-25]. A set of statistical features was obtained from 
EMG signal which are mean, mean absolute value, standard deviation, variance, skewness, number of zero 
crosses and root mean square. 

After the extraction process, a good recognition system is required to classify the data by using a 
good classifier translates to a better classification rate. Classification is a process of sorting objects into 
predetermined group which is the combination of the nearest alternatives to ease the data evaluation and 
characterize them. In this study, we used Principal Component Analysis (PCA) and Regression Tree. 

Principal Component Analysis (PCA) is a dimensionally reduction technique that is mostly used to 
change a high dimensional dataset into smaller dataset after using machine learning algorithm to study the 
data. The classifier requires enormous computation for matrix operation but using the Simple-PCA which can 
calculate eigenvectors has been proposed to reduce the computational complexity without using matrix 
operation [9]. It is a multivariable classifier which helps to reduce the size of the data set and have fewer 
dimension to be analyzed. Regression tree predicts continuous variables or regression and characterized them 
based on nodes. It is one of the oldest and powerful classification techniques which basically works by 
splitting up choices in a tree format that helps with predictive analysis. 


3. RESULTS AND ANALYSIS 

In this study, we consider seven time domain features which were extracted from the data as 
follows: (1) Mean- average value of the data, (2) Mean absolute value- to measure the gauge muscle 
contraction strength, (3) Standard deviation- measure variability from the mean of signal, (4) Variance- 
measure of how far each value in the data set is from the mean, (5) Skewness- measure the symmetry of the 
data assuming a non-Gaussian distribution in the data, (6) Number of zero crosses- measure amount of time 
the signal value changes sign and (7) Root mean square- measure of the signal energy normalized by the 
number of samples. 

The results show that both PCA and regression tree results were accurate in detecting three hand 
gestures which are paper, rock and scissors with 72.59% and 80.85% respectively. 


3.1. PCA 

The eigenvalues of PCA was managed to be found and displayed in the Figure 5. Figure 5 a) shows 
the scree plot of the fraction of total variance in the data which shows the cumulative percentage of each 
fraction, while Figure 5 b) the contribution of variables for Fl and F2. Fl and F2 were derived from the 
features extracted from the raw EMG data and tabulated which 1s shown in a low dimensional map for 
optimal view. Based on the Figure 5 b) most of the variables contributed by Fl which was then tabulated in 
Figure 6 that shows the value of variable contributed by F1. 
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The dimensional map of Fl and F2 shows that most of the features lies on the positive x-axis which 
is F]1. Its shows that Fl contribute most features. Figure 6 shows that the strongest features contributed for Fl 
are RMS, Variance, Standard Deviation and MAV with 24.4%, 23.9%, 24.4% and 20.9% respectively. The 
NZR and Skewness contribute 3.1% each while mean only contribute 0.2% to F1. 
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Figure 5. a) Scree Plot b) Dimensional map for Fl and F2 
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Figure 6. Variable distribution for Fl 


3.2. Regression Tree 

Table 1 shows the confusion matrix for the training sample where the classification and regression 
tree help the purity process of the raw data based on its predictive analysis and does a new predictive model 
to observe the data accuracy. Figure 7 shows a decision tree map of possible outcomes of the signal choices. 
The tree map was initially divided into nine nodes by variable MAV. 

From the Table 1, the highest accuracy obtained by the classifier is rock with 92.59%. The lowest 
accuracy 1s scissors with 72.50% where most of them were detected as paper. This was mainly due to 
inability to differentiate scissors and paper. The movement of scissors and rock are almost the same which 
using only two fingers. 


3.3. Future Work 

Based on the PCA results, there are only four strongest features can be used for future work to 
classify the signals. SEMG is limited to only record down the biological electrical signal of neuromuscular 
activity with different degree of great randomness and uncertainty, we intend to further this study to add 
another wearable sensor to detect hand movement from three axis attach on upper limb. Other features and 
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classifiers also can be added in the future work to verify the additional sensor as well as recruiting more 
subjects in the experiment. 

Besides, more data samples should be included for better prediction model. Since the entire system 
was managed to build from scratch and was usable, so we can focus more on the data collection part and 
more raw data can be obtained. Noise plays very important role in this experiment; thus, better noise 
reduction technique can be used to enhance the results. 
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Figure 7. Tree diagram 


Table 1. Confusion Matrix for the Training Sample 
From/To Paper Rock Scissors Total Accuracy % 


Paper Ze 2 3 2d 81.48 
Rock 0 25 p 27 92.59 
Scissors 6 5 29 40 72.50 
Total 28 32 34 94 80.85 


4. CONCLUSION 

In this paper, we described a proof-of-concept methodology to recognize three hand gestures which 
is typically used as a sign language for rehabilitation. The data collected by sEMG. Time domain feature was 
used for human activity recognition. SEMG exhibit signal patters that are distinctive for each hand gesture. 
The data was extracted into several features which are mean, MAV, standard deviation, variance, skewness, 
NZR and RMS. The features were feed into classifier which are PCA and classification and regression tree. 
Both classifiers were compared. It was found that PCA obtained accuracy of 72.59% while, regression tree 
has accuracy of 80.85%. There is still needed an improvement for the experiment. 
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